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Background: The Mood Disorder Questionnaire (MDQ) has been translated to many languages 
and has been used in many countries as a screening instrument for bipolar disorder. The main 
objective of this study was to evaluate validity of the Thai version of the MDQ as a screening 
instrument for bipolar disorder in a psychiatric outpatient sample, and to determine its optimum 
question #1 item threshold value for bipolar disorder. 

Methods: The English language Mood Disorder Questionnaire (MDQ) was translated into Thai. 
The process involved back-translation, cross-cultural adaptation, field testing of the prefinal 
version, as well as final adjustments. Two hundred and fifty major depressive disorder outpa- 
tients were further assessed by the Thai version of the MDQ and the Thai version of the Mini 
International Neuropsychiatric Intei'view (MESfl). During the assessment, reliability and validity 
analyses, and receiver operating characteristic curve (ROC) analysis were performed. 
Results: The Thai version of the MDQ screening had adequate internal consistency (Cronbach's 
alpha =0.791, omega total =0.68, and omega hierarchical =0.69). The optimal question #1 item 
threshold value was at least five positive items, which yielded adequate sensitivity (76.5%), 
specificity (72.7%), positive predictive value (74.3%), and negative predictive value (75.0%). 
The ROC area under the curve (AUC) for this study was 0.82 (95% confidence interval: 0.70 
to 0.90). 

Conclusion: The Thai version of the MDQ had some usefiil psychometric properties for screen- 
ing for bipolar disorder in a mood disorder clinic setting, with a recommended question #1 item 
threshold value of at least five positive items. 

Keywords: Thai MDQ, screening test, reliability, predictive validity, cutoff point 

Introduction 

Bipolar disorder is a common, serious, recurrent illness marked by episodes of depres- 
sion and mood elevation, and entails serious psychosocial consequences (eg, suicide, 
incarceration, bankruptcy, divorce, employment termination, occupational disability, 
and diminished social function).' It is one of the leading causes of worldwide disability, 
especially in those aged 15^4 years.^ 

Accurate diagnosis of individuals with bipolar disorder can be challenging because 
people with bipolar disorder commonly present in the more pervasive depressive 
phase and may not recall previous manic or mixed episodes, or may not be able to 
distinguish them from prior major depressive episodes, raising the risk that they 
may receive an inaccurate diagnosis of unipolar major depressive disorder.^ For 
example, in one study, approximately 70% of patients with bipolar disorder were 
misdiagnosed,* with the most common incorrect initial diagnosis being unipolar 
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major depressive disorder.^'' Misdiagnosis can lead to 
inappropriate treatment and poor treatment outcome.^ For 
example, standard antidepressants, which commonly pro- 
vide adequate efficacy and tolerability in unipolar major 
depressive disorder, when administered to individuals with 
bipolar disorder, can have inadequate efficacy (leaving indi- 
viduals depressed) and/or tolerability (causing emergence of 
manic symptoms).'* Indeed, investigators have reported that 
as many as over one-third of bipolar disorder patients may 
endure as long as a decade of affective symptoms before 
appropriate diagnosis and treatment.'* '' 

Hirschfeld et al developed the Mood Disorder Question- 
naire (MDQ), a brief self-report screening instrument for 
bipolar spectrum disorders; the MDQ detects past episodes 
of mania or hypomania via 1 3 yes/no items derived from 
both the Diagnostic and Statistical Manual of Mental 
Disorders, fourth edition (DSM-IV) criteria and clinical 
experience."' In clinical settings, the MDQ has had good 
sensitivity and specificity (73% and 90% respectively), and 
it has been translated to multiple languages and validated 
in multiple countries." " Although the sensitivity of the 
MDQ may be limited in community settings," multiple 
studies have showed that the MDQ is a valid clinical 
screening instrument for bipolar disorder, even in inter- 
national settings."" 

However, the MDQ has not been translated into and 
validated in the Thai language. In the current study, the objec- 
tive was to evaluate the validity of the Thai version of the 
MDQ as a screening instrument for bipolar disorder in major 
depressive disorder outpatients, and to determine its optimum 
question #1 item threshold value for bipolar disorder. 

Methods 

Study design 

The study was conducted at an outpatient psychiatric clinic of 
Ramathibodi Hospital, Bangkok that primarily treats general 
psychiatric patients. The protocol was approved by the Eth- 
ics Committee on Human Experimentation of the Faculty 
of Medicine, Ramathibodi Hospital, Bangkok, Thailand. 
All subjects provided verbal and written informed consent 
prior to participation. 

Participants 

The participants were native Thai-speaking adults 
(age ^18 years) recruited between October 1, 2012 and 
January 31, 2014 from the psychiatric outpatient clinic at 
Ramathibodi Hospital; all had a clinical diagnosis of unipo- 
lar major depressive disorder, determined by a psychiatrist 



using the DSM IV, Text Revision (DSM-IV-TR) criteria. 
Participants with a psychiatric or physical disorder that 
prevented them from being interviewed or undermined 
their ability to provide accurate information, and those who 
declined participation in the study or refused to provide 
informed consent, were excluded. 

Measures 

The MDQ is a self-report measure for a lifetime history of 
mania or hypomania, consisting of 1 3 yes/no symptom ques- 
tions based on the DSM-IV criteria for bipolar disorder. The 
symptom questions are followed by a single yes/no question 
about whether symptoms clustered during the same period 
of time. The final question evaluates the level of impairment 
resulting from the symptoms, with rating on a four-point scale 
(no problem, minor problem, moderate problem, or serious 
problem). After obtaining permission from the copyright 
holder, the MDQ was translated into Thai from the original 
English MDQ.'" The MDQ was translated into Thai accord- 
ing to the guidelines for cross-cultural adaptation of self- 
report measures."* The process included two independent 
forward translations of the original English MDQ into Thai, 
consensus between translators on the forward translation, 
back-translation by a bilingual English teacher, and a review 
of the back-translation by the authors. Ten patients attending 
the outpatient department were invited to complete and to 
give comments on the prefinal version. Final modifications 
and adjustments were made accordingly. 

The Mini International Neuropsychiatric Interview 
(MINI), Version 5, is a standardized clinical diagnostic 
interview schedule for DSM-IV Axis-I disorders." It can 
be reliably administered by lay interviewers who have 
appropriate training. The Thai version of MINI (which was 
translated from the English version of the MINI, Version 5)^° 
was used in this study as the "gold standard" diagnostic tool 
for identifying the presence of bipolar disorder. 

Procedure 

Subjects were recruited at their scheduled clinic visit, during 
which they completed the Thai version of the MDQ. Demo- 
graphic data (eg, sex, date of birth, religion, marital status, 
education, and occupation) were recorded. After completing 
the questionnaires, participants were then assessed for bipolar 
disorder by two research assistants who were unaware of 
the participants' MDQ results. The research assistants were 
trained to use the Thai version of MINI. ^'' Interrater reliability 
of scoring was assessed. The agreement between raters was 
satisfactory (Kappa =0.91). 
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Statistical analysis 

All statistical analysis was performed by using IBM SPSS 
Statistics for Windows, Version 21 .0 (IBM Corp., Armonk, 
NY, USA) and R and the Psy Package Version 3.1.0 
(Northwestern University, Chicago, IL, USA). Descriptive 
and analytic statistics were compiled. Cronbach's alpha 
coefficient and McDonald's omega^' were used to assess 
the internal consistency of the scale. The receiver operating 
characteristic (ROC) curve was plotted to assess the screening 
performance of the questioimaire. Its accuracy was calculated 
in terms of sensitivity, specificity, positive predictive value 
(PPV), negative predictive value (NPV), and likelihood ratio 
for each possible cutoff, and the method of linear interpola- 
tion was used to calculate the sensitivity and specificity for 
each actually possible cutoff (number of positive answers). 
The optimal question #1 item threshold value was determined 
by maximizing the Youden's index. For all analyses, a sig- 
nificant threshold of P<0.05 was used. 

Results 

Sample description 

A total of 250 outpatients with a clinical diagnosis of uni- 
polar major depressive disorder completed the Thai version 
of the Thai MDQ and were assessed using the Thai MINI. 
The mean age (standard deviation [SD]) of participants was 
46.9 (13.8) years, and 79.2% of participants were female. 
Demographic data are provided in Table 1 . 

Reliability and item analysis 

The Cronbach's alpha coefficient for the Thai version of 
the MDQ was 0.791. The McDonald's omega total and 
omega hierarchical were 0.68 and 0.69 respectively. The 
frequency of endorsement of MDQ items ranged from 
4.8% to 50.8%. The items that were endorsed most fre- 
quently were being "easily distracted" (50.8%)), having 
"decreased need for sleep" (41.2%), and having "in-itable 
mood" (36.8%). The items that were endorsed the least 
were having "increased interest in sex" (4.8%) and being 
"more social and outgoing" (6.4%). The corrected item- 
total correlations ranged from 0.24 to 0.57. All items, if 
deleted, would consistently decrease the total scale alpha 
(Table 2). 

Validity analysis 

In 250 participants who were diagnosed with major depres- 
sive disorder, a MINI diagnosis of bipolar disorder was given 
to 60 participants (24.0%) (19 [7.6%] bipolar I disorder^ and 
41 [16.4%] bipolar II disorder). 



Table I Sample description (N=250) 



Items 


Mean ± SD or number (%) 


Age (years) 


46.9±I3.8 


Sex 




Men 


52 (20.8%) 


Women 


198 (79.2%) 


Marital status 




Single 


80 (32%) 


Married 


13! (52.4%) 


Divorced 


16 (6.4%) 


Widow(er) 


16 (6.4%) 


Living as married 


7 (2.8%) 


Education 




No education 


6 (2.4%) 


Elementary school 


46 (18.4%) 


High school 


72 (28.8%) 


College degree 


92 (36.8%) 


Graduate degree 


29 (1 1.6%) 


Other 


5 (2.0%) 


Employment 




Unemployed 


72 (28.8%) 


Full time 


131 (52.4%) 


Part time 


9 (3.6%) 


Retired 


30 (12.0%) 


Other 


8 (3.2%) 


Illness characteristics 




Age of onset (years) 


39.2±I2.9 


Illness duration (years) 


7.8±8.0 (median =5) 



Abbreviation: SD, standard deviation. 



As applied in the validity study of the original (English) 
version of the MDQ, when the response to the second ques- 
tion was positive and the third question affirmed moderate 
to severe severity, the item threshold values for the first 
question, which includes 13 subitems, were determined 
by ROC analysis. Area under the curve (AUC) was 0.82 
(95% confidence interval [CI]: 0.70-0.90, /'<0.0001) 
(Figure 1). 

The sensitivity, specificity, PPV, NPV, and likelihood 
ratio for the Thai version of the MDQ using different ques- 
tion #1 positive item thresholds are provided in Table 3. For 
the Thai version of the MDQ, the sensitivity and specific- 
ity at the question #1 item threshold value of at least four 
positive items were 85.3%), and 51.5%, respectively. Using 
a question #1 item threshold value of at least five positive 
items, sensitivity and specificity were 76.5% and 72.1%, 
respectively. Using a question #1 item threshold value of 
at least six positive items, sensitivity and specificity were 
58.8% and 87.9%, respectively. 

By maximizing the Youden's index, a score of five or 
more positive items was chosen as the optimal question #1 
item threshold value for bipolar disorder as it provided a 
good balance, with not only adequate sensitivity but also. 
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Table 2 Question #1 item-level values and item-total correlation for the Thai version of the MDQ (N=250) 

MDQ question #1 items Percentages of patients who endorsed Corrected Cronbach's 



each item item-total alpha 





Major depressive 
disorder (N= 190) 


Bipolar disorder 
(N=60) 


correlation 


if item 
deleted 


A. You felt so good or so hyper that other people thought 


10.0 


48.3 


0.44 


0.78 


you were not your normal self, or you were not your 










normal self, or you were so hyper that you got into 










trouble? 










B. You were so irritable that you shouted at people or 


25.8 


71.7 


0.29 


0.79 


started fights or arguments? 










C. You felt much more self-confident than usual? 


18.4 


55.0 


0.52 


0.77 


D. You got much less sleep than usual and found you didn't 


33.2 


66.7 


0.34 


0.79 


really miss it? 










E. You were much more talkative or spoke faster than 


15.3 


48.3 


0.49 


0.77 


usual? 










F. Thoughts raced through your head or you couldn't slow 


23.7 


63.3 


0.56 


0.76 


your mind down? 










G. You were so easily distracted by things around you that 


43.2 


75.0 


0.39 


0.78 


you had trouble concentrating or staying on track? 










H. You had much more energy than usual? 


10.5 


45.0 


0.57 


0.76 


1. You were much more active or did many more things 


21.1 


46.7 


0.54 


0.77 


than usual? 










J. You were much more social or outgoing than usual; for 


2.6 


18.3 


0.35 


0.78 


example, you telephoned friends in the middle of the 










night? 










K. You were much more interested in sex than usual? 


3.2 


10.0 


0.24 


0.79 


L. You did things that were unusual for you or that other 


17.9 


53.3 


0.47 


0.77 


people might have thought were excessive, foolish, or 










risky? 










M. Spending money got you or your family into trouble? 


12.6 


35.0 


0.28 


0.79 



Abbreviation: MDQ, Mood Disorder Questionnaire. 



adequate specificity. By using this five or more question #1 
item threshold, more than seven out of ten people with a 
bipolar disorder would be expected to be correctly identified 
by the Thai version of the MDQ, whereas more than seven 




Sensitivity 
Specificity 



Number of manic items 
checl^ed positive 

Figure I Sensitivity and specificity of the MDQ for bipolar disorder at different 
cutoffs. 

Notes: Area under the curve was 0.82 {95% confidence interval: 0.70-0.90, 
P<O.OOOI). 

Abbreviation: MDQ, Mood Disorder Questionnaire. 



out of ten of those who did not have a bipolar disorder would 
be expected to be successfully screened out. 

Discussion 

The internal consistency of the Thai version of the MDQ in 
this study (Cronbach's alpha coefficient =0.79) was margin- 
ally lower than in the studies of the original English MDQ 
from the United States (alpha coefficient =0.84-0.90).'"" 
However, the reliability of the Thai MDQ was within the 
acceptable range as Cronbach's alpha coefficient was greater 
than 0.70.'^ The participants in this study had high rates of 
endorsement of distractibility, decreased need for sleep, 
and irritable mood, which were consistent with results from 
previous studies.'" '^ 

When the Thai version of the MDQ was examined as 
a continuous measure, its validity was supported by an 
AUC value of 0.82 (95% CI; 0.70-0.90), which being 
greater than 0.80, suggested adequate accuracy. The sen- 
sitivity and specificity using a question #1 item threshold 
value of at least five positive items were also adequate. 
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Table 3 Sensitivity, specificity, PPV, NPV, and LR of the Thai version of the MDQ for diagnosis of bipolar disorder 





i9Cl I3l LI VI LV \/Of 


iSLJC^I 1 IVilLV I /O 1 


PPV (%) 


NPV (%) 


ruaiLivc 




>3 


94.1 


45.5 


64.0 


88.2 


1 .7 


0.1 




85.3 


5 1.5 


64.4 


77.3 


1 .8 


0.3 


>s 


76.5 


72.7 


74.3 


75.0 


2.8 


0.3 


>6 


58.8 


87.9 


83.3 


67.4 


4.9 


0.5 


>7 


47.1 


90.9 


84.2 


62.5 


5.2 


0.6 


>8 


32.4 


93.9 


84.6 


57.4 


5.3 


0.7 


>9 


17.7 


97.0 


85.7 


53.3 


5.8 


0.9 



Abbreviations: LR, likelihood ratio; MDQ, Mood Disorder Questionnaire; NPV, negative predictive value; PPV, positive predictive value. 



being 76.5% and 72.7%, respectively. Moreover, using a 
question #1 item threshold value of at least five positive 
items also yielded an adequate PPV and NPV, of 74.3% 
and 75.0%, respectively. Results from other studies of the 
MDQ in clinical settings have included PPV ranging from 
to 18.4%-96% (depending on cutoff). In our study, 
the optimal question #1 item threshold value of at least five 
positive items was comparable with that reported in studies 
from China"^' but was more liberal than the question #1 
item threshold value of at least seven positive items reported 
in studies from the United States,'" France,^*" Turkey,-" and 
Hong Kong.^^ It has been proposed that the difference in 
optimal cutoff value from these studies might partly be due 
to cultural differences.^' 

Our study has several noteworthy limitations. First, par- 
ticipants were patients already being treated in a university 
hospital; therefore, the participants may not be representative 
of the patients usually treated in non-university community 
settings and were certainly not representative of heteroge- 
neous groups of individuals with and without depression 
in the community, in general. Second, although the Thai 
version of the MINI performed well in a validity study," it 
is still possible that it overestimated or underestimated the 
rate of manic/hypomanic symptoms in our study. Third, 
our somewhat liberal question #1 item threshold value of 
at least five versus seven (used in some countries) positive 
items could have overestimated the prevalence of clini- 
cally significant manic/hypomanic symptoms. Fourth, the 
test-retest reliability of the Thai version of the MDQ was 
not assessed. Generally, this type of reliability is used for 
measuring the stability of a scale over time, and it is usu- 
ally assessed after a short period of time. Fifth, there were 
substantial limitations on the MDQ's ability to accurately 
detect "bipolarity", including the risks of misdetection 
of borderline personality disorder-' and attention-deficit/ 
hyperactivity disorder^^ as bipolar disorder. Finally, the 
ability to detect bipolarity in this study was only assessed 
in patients who were already professionally diagnosed as 



having had major depressive episodes; in this regard, our 
sample had a larger percentage of female subjects and a 
later onset age compared with most cohorts of patients with 
bipolar disorder. 

Conclusion 

In summary, the Thai version of the MDQ had some useful 
psychometric properties for screening for bipolar disorder in 
a mood disorder clinic setting, with a recommended question 
one item threshold value of at least five positive items. Thus, 
the Thai MDQ may be a useful instrument to identify a risk 
for bipolar disorder in Thai clinical settings. However, if the 
patient screens positive for possible bipolar disorder with 
the MDQ, the physician should proceed with full clinical 
evaluation for bipolar disorder.-' Further population-based 
research is needed to assess whether the Thai version of the 
MDQ would be useful in other settings, particularly as the 
original English MDQ had limited sensitivity in a (nonclini- 
cal) community setting. 
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